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(54) METHOD AND DEVICE FOR MOVING PICTURE DATA 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a method and a 
device for recording moving picture data that can acquire 
excellent image data even when a still picture is ! 
extracted from the moving picture while reducing a 
recording capacity in the case of photographing the 
moving picture. j 
SOLUTION: When a high image quality mode button is 
depressed during recording of a moving picture in a 
digital camera recording moving picture data, a data j 
compression rate is set lower during the depression and 
image data are recorded with high image quality. A j 
motion JPEG form, e.g. is adopted for the compression 
and a received image (original image) is divided into 
blocks each consisting of 8x8 pixels, a coder 82 applies 
orthogonal conversion, quantization and Huffman coding to the input image blocks and 
provides an output of compressed data. The coder 82 has two kinds of quantization tables; a 
table (92) for standard and a table (94) for high image quality and the quantization table used 
by a quantizer 88 is selected in interlocking with an operation of a high image quality mode 
button 14. 
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(11) Japanese Patent Laid-Open No. 2000-333130 

(43) Laid-Open Date: November 30, 2000 

(21) Application No. 11-141499 

(22) Filing Date: May 21, 1999 

(71) Applicant: FUJI PHOTO FILM CO LTD 

(72) Inventor: Hisanobu TSUBAKI 

(54) Title of the invention: MOVING IMAGE DATA RECORDING 
METHOD AND APPARATUS 

(58) Abstract 

[Problem to be Solved] 

To provide a moving image data recording method and 
apparatus in which the storage capacity can be reduced when 
moving images are taken and high quality image data can be 
obtained when a still image is extracted from moving images. 

[Solution] 

In a digital camera capable of recording moving image 
data, when a high quality image mode button is pressed 
while moving images are being recorded, a low compression 
rate of data is set while the button is pressed, and the 
image data is recorded with high quality image. For 
compression, for example, a motion JPEG format is adopted, 
an input image (original image) is divided into 8x8 
blocks, an encoder 82 performs an orthogonal transformation, 
quantization, and Huffman coding for each 8x8 pixel block 
to output compressed data. The encoder 82 has two types of 
quantization tables, that is, a standard (92) table and a 
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high quality image 
used by a quantizer 
operation of a high 



(94) table, and the 
88 are switched in 
quality image mode 



quantization tables 
connection with the 
button 14. 
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[Claims for the Patent] 
[Claim 1] 

A moving image data recording method of recording 
moving image data obtained by coding a signal representing 
moving images on a recording medium, characterized in that 

by receiving an image guality change instruction 
while moving images are being recorded, recorded image 
quality is switched between high and low qualities to 
record data representing the moving images on the recording 
medium. 
[Claim 2] 

The moving image data recording method according to 
claim 1, characterized in that 

compression rate of each image is changed to switch 
the recorded image quality, by issuing said image quality 
change instruction. 
[Claim 3] 

The moving image data recording method according to 
claim 2, characterized in that 

a data compression format is a motion JPEG format. 
[Claim 4] 

The moving image data recording method according to 
claim 2, characterized in that 

the compression rate is changed by switching 
quantization tables. 
[Claim 5] 

The moving image data recording method according to 
- 3- 
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claim 1, characterized in that 

an MPEG format is adopted as a coding format, and 
image guality is improved using space scalability. 
[Claim 6] 

The moving image data recording method according to 
claim 1, characterized in that 

an MPEG format is adopted as a coding format, and 
image quality is improved by increasing a frequency of 
insertion of an I picture. 
[Claim 7] 

A moving image data recording apparatus which records 
moving image data obtained by coding a signal representing 
moving images on a recording medium, characterized by 
comprising : 

image quality change instruction means for issuing an 
image quality change instruction while moving images are 
being recorded; and 

image quality switching means for switching image 
quality of moving images recorded on the recording medium 
between high and low qualities, by receiving an image 
quality change instruction while moving images are being 
recorded . 
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[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

The present invention relates to a moving image data 
recording method and apparatus, and more specifically to 
technology applied to equipment such as an electronic 
camera etc. for recording moving images on a recording 
medium. 

[0002] 

[Conventional Art] 

As a technique relating to the data size and image 
quality of moving images, there has conventionally been a 
method of setting a recording mode in advance as in the 
case of a still image and switching the data size and image 
quality of moving images. The Japanese Patent Laid-Open No. 
5-115055 discloses an image coding and compressing 
apparatus for switching the frequency bands of analog 
information to level a data rate. As other methods for 
leveling a data rate, there has been a method of 
manipulating a compression rate by detecting the amount of 
movement of a subject, a method of changing the compression 
rate of voice data depending on the amount of compression 
code, and a method of using a buffer to level a transfer 
rate . 
[0003] 

The Japanese Patent Laid-Open No. 5-268566 discloses 
a multimedia processing apparatus for changing a 
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compression rate of moving images and voice depending on 
the transfer speed of an input/output device. The Japanese 
Patent Laid-Open No. 6-18929 discloses a moving image 
compression apparatus for raising the compression rate of a 
portion of an image having a large amount of motion and not 
requiring very high quality. 
[0004] 

[Problems to be Solved by the Invention] 

Unlike still images, however, a subject is rarely 
aware of a camera operator while taking moving images. 
Therefore, a camera operator often starts taking a moving 
image shortly before a point where the operator really 
wants to take, and unnecessary data is also taken. 
Particularly, when a recording is performed in a high 
quality image mode, the data size of moving images is large, 
so that the recording time with respect to a recording 
medium is reduced. 
[0005] 

In addition, when a part of moving images is 
extracted as a still image, and is used for other uses such 
as printing etc., there is the problem of poor image 
quality of moving images taken in a usual way. The present 
invention has been developed to solve the problem, and aims 
at providing a moving image data recording method and 
apparatus in which the storage capacity can be reduced when 
moving images are taken and high quality image data can be 
obtained when a still image is extracted from moving images. 
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[0006] 

[Means for Solving the Problems] 

To attain the above-mentioned advantages, the 
invention according to claim 1 is a moving image data 
recording method of recording moving image data obtained by 
coding a signal representing moving images on a recording 
medium characterized in that, by receiving an image quality 
change instruction while moving images are being recorded, 
recorded image quality is switched between high and low 
qualities to record data representing the moving images on 
the recording medium. 
[0007] 

According to the present invention, recorded image 
quality can be changed at any time while taking moving 
images in response to an image quality change instruction. 
Therefore, an image quality change instruction can be 
issued only as necessary while taking moving images to 
switch to a high quality image mode, and it is not 
necessary to set recording image quality in a high quality 
image mode in advance, thereby reducing a required storage 
capacity. In addition, excellent image data can also be 
obtained when a part of moving images are extracted as 
still images from moving images taken in the high quality 
image mode . 
[0008] 

As means for switching recorded image quality, as 
described in claim 2, the compression rate of each image 
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can be changed. As a data compressing format, for example, 
as described in claim 3, a motion JPEG format is adopted. 
Furthermore, as means for changing the compression rate, as 
described in claim 4, quantization tables can be switched. 
[0009] 

As other means for switching recorded image quality, 
image quality is improved using spatial scalability in the 
MPEG format as described in claim 5, and image quality is 
improved by increasing the frequency of insertion of an I 
picture in the MPEG format as described in claim 6. The 
invention according to claim 7 provides an inventive 
apparatus for embodying the above-mentioned inventive 
method, and is a moving image data recording apparatus 
which records moving image data obtained by coding a signal 
representing moving images on a recording medium, 
characterized by comprising: image quality change 
instruction means for issuing an image quality change 
instruction while moving images are being recorded; and 
image quality switching means for switching image quality 
of moving images recorded on the recording medium between 
high and low qualities, by receiving an image quality 
change instruction while moving images are being recorded. 
[0010] 

[Embodiments of the Invention] 

The preferred embodiments of the moving image data 
recording method and apparatus according to the present 
invention are described with reference to the attached 
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drawings. Figure 1 is a back view of the digital camera to 
which the present invention is applied. As shown in Figure 
1, a digital camera 10 is provided with a liquid crystal 
monitor 12 as a display device, a high quality mode button 
14, a set button 16, and a cursor 18. Figure 1 also shows 
a finder 20 and a shutter button 22 corresponding to a 
recording button. 
[0011] 

The digital camera 10 can record moving images on a 
recording medium (for example, a memory card) . When the 
shutter button 22 is pressed once, a moving image recording 
operation is started, and when the shutter button 22 is 
pressed again, the moving image recording operation is 
terminated. The moving images are recorded in an AVI file 
in a motion JPEG format, the voice in the moving images is 
recorded in a PCM format. When the high quality mode 
button 14 is pressed while moving images are being recorded, 
the compression rate of data is set low while the button is 
pressed, and the image data is recorded with high quality 
image . 
[0012] 

The cursor 18 is an operation unit for moving the 
position of the cursor (or pointer) not shown in the 
attached drawings but displayed on the screen of the liquid 
crystal monitor 12, and is configured by a cross key 
capable of freely specifying the four directions, that is, 
up, down, right, and left. A user operates the cursor 18, 
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sets the cursor at a desired point, and then presses the 
set button 16, thereby performing a selection or input 
depending on the position of the cursor. 
[0013] 

The cursor 18 is also used for forwarding/returning 
operations during reproduction of images. The cursor 18 
can be replaced with other pointing devices such as a touch 
pad, a track ball, a joy stick, etc. A touch panel can be 
arranged on the liquid crystal monitor 12 . Figure 2 is a 
block diagram of the configuration of the digital camera 10. 
As shown in Figure 2, the digital camera 10 is configured 
by a shooting lens 24, an iris and mechanical shutter 26, a 
CCD 28 as an image pickup element, an analog signal 
processing unit 30, an A/D converter 32, a memory 
controller 34, frame memory 36, a digital signal processing 
unit 38, a compression/decompression circuit 40, a card 
interface 42, a memory card 44, a image data bus 46, a host 
bus 48, a central processing unit (CPU) 50, a CPU 
peripheral circuit 52, a timing generator 54, VRAM 56, an 
encoder 58, a D/A converter 60, a liquid crystal monitor 12, 
and various operation units such as a record/reproduction 
switch 62, a shutter button 22, etc. 
[0014] 

The image light representing a subject is formed as 
an image on the photo-receiving surface of the CCD 28 
through the shooting lens 24 and the iris and mechanical 
shutter 26, and converted into a signal electric charge of 



-10- 



JPA2000-333130 



the amount depending on the light guantity of the image 
light. The signal electric charge photo-electrically 
converted by each photosensitive pixel of the CCD 28 is 
sequentially transferred based on the drive pulse applied 
from the CCD drive circuit controlled by the CPU 50 but not 
shown by the attached drawings and read as a voltage signal 
(image signal) depending on the signal electric charge. 
The CCD 28 has the function of what is called an electronic 
shutter capable of discharging unnecessary accumulated 
electric charge by a shutter gate pulse applied from the 
CCD drive circuit, and thereby controlling the electric 
charge accumulation time. 
[0015] 

The signal read from the CCD 28 is processed in a 
predetermined operation including a color separation, a 
gain adjustment, etc. by the analog signal processing unit 
30, added to the A/D converter 32, and converted into R, G, 
and B digital image data. The R, G, and B digital image 
data output from the A/D converter 32 is accumulated in the 
frame memory 36 through the memory controller 34 controlled 
by the CPU 50. The image data accumulated in the frame 
memory 36 is read by the memory controller 34, and supplied 
to the digital signal processing unit 38. 
[0016] 

The digital signal processing unit 38 includes a 
brightness/color difference signal conversion circuit, a 
gamma correction circuit, etc. RGB data input to the 
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digital signal processing unit 38 is converted into a 
brightness signal (Y signal) and a color difference signal 
(Cr, Cb signal) in the digital signal processing unit 38, 
and after a predetermined process such as a gamma 
correction etc. is performed, written back to the frame 
memory 3 6 again. 
[0017] 

The brightness/color difference signal (YC signal for 
short) is read by the memory controller 34, and supplied to 
the compression/decompression circuit 40. Then, after the 
YC signal is compressed by the compression/decompression 
circuit 40 in the motion JPEG format, it is recorded on the 
memory card 44 through the card interface 42. The 
compressing process and the writing (recording) process are 
simultaneously performed concurrently. The mode of the 
recording medium is not limited to the memory card, but can 
be a PC card, a magnetic disk, a magneto optical disk, a 
memory stick, etc. 
[0018] 

The audio data in moving images is acquired by A/D 
converting the signal from a microphone not shown in the 
attached drawings, and recorded on the memory card 44. The 
YC signal obtain by the digital signal processing unit 38 
is supplied to the VRAM 56, and the data stored in the VRAM 
56 is supplied to the liquid crystal monitor 12 through the 
encoder 58 and the D/A converter 60. Thus, the image taken 
by the CCD 28 is displayed on the liquid crystal monitor 12 
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in real time, or not in real time but as substantially 
continuous moving images. Therefore, the user can 
determine the configuration of a subject while watching the 
screen of the liquid crystal monitor 12. The video signal 
output from the D/A converter 60 can also be externally 
output from a video output terminal not shown in the 
attached drawings . 
[0019] 

In addition, in the reproduction mode, after an image 
recorded on the memory card 44 is read and decompressed by 
the compression/decompression circuit 40, it is provided 
for the VRAM 56. The data stored in the VRAM 56 is 
supplied to the liquid crystal monitor 12 through the 
encoder 58 and the D/A converter 60. Thus, the contents of 
the image stored in the memory card 44 can be confirmed on 
the screen of the liquid crystal monitor 12. In addition 
to the taken image and the reproduced image, the 
information about the remaining capacity of the memory card 
44, the recording time, the remaining amount of a battery, 
etc. is displayed on the liquid crystal monitor 12. 
[0020] 

The CPU 50 corresponds to the control device for 
controlling the camera system, integrally controls each 
circuit based on the input of a signal from each operation 
unit received through the CPU peripheral circuit 52, and 
operates the camera according to a predetermined control 
program. The CPU 50 controls the timing generator 54, and 
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each circuit is synchronized according to a synchronization 
signal supplied from the timing generator 54 to each block. 
The CPU peripheral circuit 52 includes a timer, a direct 
memory access (DMA) circuit, an interrupt control circuit, 
a parallel input/output port, etc., and the operation 
signal of each operation unit such as a shutter button 22 
etc. is reported to the CPU 50 through the CPU peripheral 
circuit 52 . 
[0021] 

The record/reproduction switch 62 is an operation 
unit for switch between the record mode and a reproduction 
mode. The "record mode" is an operation mode in which the 
image taken by the CCD 28 is recorded on the memory card 44. 
The "reproduction mode" is an operation mode in which the 
image data stored in the memory card 44 is reproduced and 
output to the liquid crystal monitor 12, and data is output 
to the external equipment through a video terminal etc. 
The reproduction mode is also used as an edition mode in 
which various data associated with image data is edited. 
[0022] 

Figure 3 shows the concept of the structure of the 
motion JPEG data. As shown in Figure 3, a motion IPEG data 
70 is configured by an AVI header 72, an image data header 
73, an audio data header 74, AVI attached information 75, 
moving image data 76, and a data index 77. The AVI header 
72 stores the information about the entire AVI file. The 
AVI header stores, for example, the information about a 
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frame rate (number of seconds per frame) etc. 
[0023] 

An image data header 73 stores the information about 
image data. For example, the reproduction size, a data 
format (since the camera is in the motion JPEG, the code 
indicating the JPEG), etc. are stored in the header of the 
image data. The audio data header 7 4 stores the 
information about audio data. For example, a sample rate 

(frequency), the number of channels, the number of bits per 
sample, etc. are stored. 

[0024] 

In the portion of the moving image data 76, the body 
of the moving image data is recorded. In the body of the 
moving image data, data composed of still images forming 
each picture compressed in the JPEG format (VideoData) and 
the corresponding audio data (AudioData) are recorded in an 
interleaved manner. In addition to the present embodiment, 
an audio file can be independently stored. In the portion 
of the data index 77, each image data (VideoData) in the 
moving image data 76 and the necessary information (address 
etc.) for access to the audio data (AudioData) are stored. 
[0025] 

Figure 4 is a block diagram of the procedure of the 
image data compressing process in the digital camera 10. 
In Figure 4, an input image (original image) 80 is divided 
into 8x8 pixel blocks, and an encoder 82 performs an 
orthogonal transformation, quantization, and entropy coding 
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on each 8x8 pixel block, and outputs compressed data 84. 

The decoding algorithm is inverse to the coding. 

[0026] 

The encoder 82 is included in the 
compression/decompression circuit 40 described with 
reference to Figure 2. The encoder 82 is configured by an 
orthogonal converter 86, a quantizer 88, and a Huffman 
encoder 90. The orthogonal converter 86 performs an 
orthogonal transformation on the input image data and 
decomposes the data into frequency components according to 
the method called a discrete cosine transform (DCT 
transform) . The quantizer 88 quantizes a result of the 
orthogonal transformation using a quantization table 92 (or 
94) . 
[0027] 

The encoder 82 is provided with two types of 
quantization tables, that is, the standard quantization 
table 92 and the high quality image quantization table 94. 
By the operation of switching means 96 in cooperation with 
the operation of the high quality mode button 14, the 
quantization tables used by the quantizer 88 can be 
switched. The high quality image quantization table 94 has 
smaller settings of quantizing steps than those of the 
standard quantization table 92. During normal shooting, 
the standard quantization table 92 is used. When high 
quality image recording is performed by the operation of a 
user (when the high quality image mode button is operated) , 
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the high quality image quantization table 94 is used. 
[0028] 

The Huffman encoder 90 uses the Huffman coding system 
to further compress the quantized data. Information about 
a header etc. is added to the compressed data 84 obtained 
through the orthogonal converter 8 6, the quantizer 88, and 
the Huffman encoder 90, and a piece of image data in the 
motion JPEG is generated. 
[0029] 

Using the digital camera 10 with the above-mentioned 
configuration, the image quality of a specified portion in 
a series of moving image scenes can be improved by a user 
freely operating the high quality mode button 14 when 
moving images are taken. Thus, it is not necessary to set 
a high quality image mode in advance as an image mode, but 
the high quality image mode can be specified only as 
necessary while taking moving images, thereby reducing the 
storage capacity. 
[0030] 

When images are taken in the high quality image mode, 
the image data of each image is recorded with high quality 
image. Therefore, when a part of moving images is 
extracted as a still image, and is used for printing etc., 
excellent image data can be obtained. In Figure 4, two 
types of table, that is, the quantization tables 92 and 94 
are prepared in advance, but three or more types of 
quantization tables can be prepared, and the high quality 
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mode button 14 can be replaced with image quality selection 
means capable of selecting one mode from among the three or 
more types of image quality modes, thereby changing image 
quality in multiple types. Furthermore, the quantization 
tables 92 and 94 can be replaced with a quantization table 
generator 98 as shown in Figure 5 to provide a parameter 
from a control unit 100 depending on the operation of the 
high quality mode button 14 and generate a standard and a 
high quality image quantization table depending on the 
setting of the parameter. The control unit 100 corresponds 
to the CPU 50 and the CPU peripheral circuit 52 shown in 
Figure 2 . 
[0031] 

With the configuration shown in Figure 5, the 
quantization table generator 98 generates a standard 
quantization table when a normal shooting operation is 
performed, and a standard quantization table is provided 
for the quantizer 88. When the high quality mode button 14 
is pressed, a parameter corresponding to the high quality 
image mode is provided from the control unit 100 to the 
quantization table generator 98. The quantization table 
generator 98 generates a high quality image quantization 
table depending on the parameter received from the control 
unit 100, and provides the table for the quantizer 88. 
Thus, only when the high quality mode button 14 is pressed, 
a high quality image recording operation can be performed. 
[0032] 
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In the above-mentioned embodiment, an example of 
motion JPEG of listing the images of each screen as 
independent JPEG images is described. However, the present 
invention is not limited to this application, and the MPEG 
(moving images experts group) system and other formats can 
be used. For example, in the MPEG 2, a scalability 
function is implemented, and two or more types of images 
having different spatial resolutions, time resolutions, and 
SNRs (signal to noise ratio) can be decoded from one bit 
stream. In the scalability functions, the spatial 
scalability is used to obtain a high resolution image and a 
low resolution image. 
[0033] 

In the MPEG 2, a layer having a low spatial 
resolution is called a basic layer, and a layer having a 
high spatial resolution is called a high order layer. The 
basic layer is coded in the MPEG 2 coding method. On the 
other hand, in the expanded layer, an image of the basic 
layer is up-sampled (by adding pixels of an average value 
etc. between the pixels on the low resolution screen to 
generate a high resolution screen) and an image of the same 
size as in the high order layer is generated. Thus, not 
only a prediction from an image in the high order layer but 
also a prediction from an up-sampled image can be performed, 
thereby performing coding more efficiently (reference 
document "Latest MPEG Text" by Hiroshi Fujiwara published 
by ASCII Publishing Corporation) . 
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[0034] 

When an operation is performed in a high quality 
image mode depending on the operation of the high quality 
mode button 14 while normally obtaining a normal quality 
image (low resolution image) only from basic layer 
information, both basic layer information and high order 
layer information are used to obtain a high resolution 
image. In the MPEG algorithm, coded image data is 
generated based on the preceding and subsequent screen data, 
and has a GOP (group of pictures) structure as a group of 
several pieces of screen data. Since a bidirectional 
prediction is realized in the MPEG, three types of pictures, 
that is an I picture, a P picture, and a B picture, are 
prescribed. The I picture is an Intra coded image (intra 
frame coded image) , the P picture is a Predictive coded 
image (inter-frame forward prediction coded image) , and the 
B picture is a bidirectionally predictive coded image 
(bidirectional prediction coded image) . Since the I 
picture is a compressed image in only the method of not 
maintaining the preceding and subsequent correlation in the 
intra-frame compression, the insertion frequency of the I 
picture is increased when the high quality image mode is 
set, thereby obtaining a high resolution image. 
[0035] 

In the embodiment above, the removable memory card 44 
is used as a recording medium, but internal memory built in 
the digital camera 10 can be used as a recording medium. 
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In this case, the image data obtained by shooting is output 
to an external unit using cable or wireless communication 
means. As a variation example of the present embodiment, 
the digital camera 10 includes a still image recording mode 
and a moving image recording mode, and the still image 
recording and the moving image recording can be switched by 
setting a mode switch not shown in the attached drawings. 
[0036] 

In this case, the CCD of high pixel counts is used to 
obtain a high definition still image, and an ability to 
thin the pixels of image data obtained from the CCD is 
provided. Means for thinning the pixels can thin pixels 
when a signal electric charge is read from the 
photoelectric pixel of the CCD, or the image data stored in 
the frame memory is thinned and read, or the combinations 
of the thinning processes can be used. 
[0037] 

With the configuration of a camera, a high resolution 
image is obtained by acquiring data of all pixels without 
thinning in a still image shooting operation while pixels 
are thinned to obtain an image when standard moving images 
are taken. When the high quality mode button 14 is pressed 
during moving images are being taken, the thinning process 
is suppressed, or the amount of thinned pixels is reduced 
to obtain a high resolution image. 
[0038] 

[Advantages of the Invention] 
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As described above, according to the present 
invention, the recorded image quality is switched depending 
on the image quality change instruction while moving images 
are being taken. Therefore, it is not necessary to set the 
recorded image quality in the high quality image mode, and 
the storage capacity can be reduced. In addition, when a 
part of moving images taken in the high quality image mode 
can be extracted as a still image, excellent image data can 
be obtained. 

[Brief Description of the Drawings] 
[Figure 1] 

Figure 1 is a back view of the digital camera to 
which the present invention is applied. 
[Figure 2] 

Figure 2 is a block diagram of the configuration of 
the digital camera to which the present invention is 
applied . 
[Figure 3] 

Figure 3 shows the concept of the structure of the 
motion JPEG data. 
[Figure 4] 

Figure 4 is a block diagram showing the procedure of 
the image data compressing process using the digital camera 
according to an embodiment of the present invention. 
[Figure 5] 

Figure 5 is a block diagram of other procedures of 
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the compressing process of the image data in the digital 
camera according to an embodiment of the present invention. 

[Description of Symbols] 

10 ... digital camera (moving image data storage 
device) , 12 ... liquid crystal monitor, 14 ... high quality 
mode button (image quality change instruction means) , 44 
memory card (recording medium) , 50 ... CPU (image quality 
switching means), 88 ... quantizer (image quality switching 
means), 92, 94 ... quantization table, 96 ... switching 
means (image quality switching means), 98 ... quantization 
table generator (image quality switching means) 
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Figure 2 
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Figure 3 
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Figure 4 
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Figure 5 
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